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University of Illinois 


Abstract 


This paper presents three case studies that examined the use of ClassTranscribe in a diverse set 
of undergraduate engineering classes in 2019 and 2020 at the University of Illinois at 
Urbana-Champaign. ClassTranscribe, a video viewing system designed with accessibility and 
learning in mind, was first presented to the ASEE community in 2019 [1]. The pedagogical 
features of the tool include: pause, leave and resume viewing; captions available in multiple 
languages; downloadable transcriptions; shareable links to video moments; and searchable 
content within each video and across an entire course. The importance of the tool in the context 
of a commitment to accessibility for engineering education is discussed. In addition, online video 
content that follows Universal Design for Learning principles enables all students to prepare for 
assessments and provides more equitable learning opportunities. Low-stress online learning 
opportunities may be particularly valuable for underrepresented minorities (e.g., [2] explored 
relative student improvement in multiple exams assessments in an online course with video 
lectures). The first study presented here describes two extremes: a supplemental-resource 
approach and primary-resource approach in the adoption of ClassTranscribe into an Electrical 
and Computer Engineering (ECE) and Computer Science (CS) course, respectively. In Spring 
2020, ECE students used the tool as a supplemental learning resource to review and search live 
lecture captures. Whereas in the sophomore CS course (N=271 students), physical lectures were 
canceled and ClassTranscribe was used as a primary learning resource using short-length (<10 
minute) videos. The methodology and analysis of the CS course outcomes were described in [3] 
but relevant findings are reproduced here: Students in the lowest quartile improved by 3.3 
percentile points compared to previous semesters and statistically-significant positive learning 
outcomes were found at all levels of student performance. Each quartile of students who used the 
tool an above average amount of time led to increased final exam scores, with the lowest quartile 
increasing 14.4 absolute points compared to their in-quartile peers. A new contribution of this 
paper is an analysis of the interactions with the tool, which found three event types: 
Fullscreen-viewing, Change-playback-speed and Search-Transcription predicted improved exam 
performance and were statistically significant (p<0.01). In the second case study, video 
instruction was used to present safety and lab-handling techniques in a Bioengineering class 
prior to rigorous lab assessment. The student-specific analytic data available to the course 
instructor using the web interface allowed the instructor to check that each student had 


completed training materials prior to lab work. Student surveys measured several factors 
including the utility of the tool and students’ preferences in video systems and video-based 
Bioengineering instruction. In the third case study, student feedback from CS and ECE courses 
were solicited on learning utility and digital accessibility. The majority of the 206 responses 
reported high utility (“moderately useful” or greater) of the tool when working on assignments 
(67%) and preparing for an exam (77%). The majority of respondents (96%, n=239) 
recommended the tool be re-used in future semesters of their course. We present example survey 
questions that respect student choice to not-self disclose a disability. 


Introduction 


This paper presents the educational impact of adding accessible video content using an 
accessible video player to courses in 3 undergraduate engineering majors: Bioengineering, 
Computer Science and Electrical and Computer Engineering. The web interface of the open 
source video platform, ClassTranscribe, was designed and created specifically to enhance student 
learning; support students with disabilities including vision, auditory, motor and cognitive 
disabilities; and provide detailed behavioral per-student data that is relevant to students, 
instructors and educational researchers. 


This paper is organized as follows. The background section provides a broader context of the 
work presented here: i) Motivation for the need to improve digital accessibility in engineering 
education, 11) The challenges of providing equitable access to all students, iii) Use of video for 
learning, iv) How application of Universal for Design for Learning principles and online content 
may provide greater equity and access, v) The limited understanding of imposter syndrome 
effects and interventions in engineering education and the potential to improve students’ 
self-confidence. Three case studies are presented. The first case study described the use of the 
tool in CS and ECE courses and analyzed which student behaviors lead to statistically-significant 
favorable learning outcomes. The second case study examined the use of ClassTranscribe to 
address challenges of a Bioengineering laboratory course and student preferences for further use 
of ClassTranscribe-based learning in Bioengineering. The third case study surveyed students to 
gain insights into accessibility and utility of the accessible video from the perspective of 
engineering students who used the tool in computing and computing engineering contexts. 


Background 


The National Center for Science and Engineering Statistics (NCSES) publishes detailed tabular 
data on the demographic characteristics, enrollment, degrees, and employment of women, 
minorities, and persons with disabilities in science and engineering (see Table 2-6 of [4]). In 
2016, using the NCSES definition, “any type of disability related to blindness, deafness, severe 


vision or hearing impairment, substantial limitation of mobility, or any other physical, mental, or 
emotional condition that lasted 6 months or more,” there were 3,807,100 students classified as 
disabled and enrolled in college (52% of those are in 4-year programs), which represents 
approximately 19% of the total undergraduate enrollment in the U.S. Of which there were 
203,793 disabled students enrolled in engineering, excluding computer science (Table 2-7 of 
[4]). For 2015, engineering, computer science or math undergraduate degrees, the NCSES 
reports 19.6% of students have a disability (Table 311.10 of [5]). So, where are they? 


Though some disabilities are visible, many are invisible. An instructor may be unaware that they 
have students with color-blindness, low vision, partial deafness, low mobility, low dexterity, 
attention deficit hyperactivity disorder (ADHD), attention deficit disorder (ADD), autism, 
tinnitus, dyslexia ..., and other physical and cognitive impairments not listed here that a student 
does not need to disclose. Further, a 2017 study at a Wisconsin university found that 75% of 
students chose not disclose their disability to their university [6] and preferred their impairment 
to remain invisible. Respecting non-disclosure in student surveys is also discussed in the third 
study below. 


The design of today's digital interfaces and the digital content rarely consider impairments and 
disabilities. In short, they are digitally inaccessible. Practical, comprehensive digital accessibility 
remains an elusive problem across multiple engineering education fields. Over time, each 
technological barrier further reduces the talent pool and ultimate diversity and ingenuity of our 
future commercial workforce and academic faculty. For example, modern CS-STEM' positions 
report less than 1-2% of their workforce identify as disabled, and some high profile companies 
prefer to remain silent [7]. The education pipeline for engineering students is ripe for 
improvement. 


The utility of online videos, online courses and entire online programs offered at scale (Coursera, 
edX) has been, and continues to be, the subject of innovation, scholastic research and criticism 
(e.g. [3], [8]-[10]). In this paper, we consider the availability of accessible video content as an 
application of the first principle of Universal for Design for Learning (UDL) (e.g. [11] [12], 
[13]). UDL’s three principles are: “1) multiple methods of representation that give learners a 
variety of ways to acquire information and build knowledge; 2) multiple means of student action 
and expression that provide learners alternatives for demonstrating what they have learned; and 
3) multiple modes of student engagement that tap into learners’ interests, challenge them 
appropriately, and motivate them to learn.” Some advantages of UDL to students in engineering 
courses and the benefits to the university are presented in the Conclusions section below. 


' Computer science, science technology engineering and math disciplines 


Engineering courses with rigorous assessments of demanding technical skills are an intimidating 
barrier to unconfident undergraduates. A lack of confidence and limited belief in long-term 
success in a major, can undermine a student’s success in a chosen major. These negative factors 
are more common in underrepresented minority students and thus, may ultimately reduce 
retention of underrepresented minorities in an engineering major, and/or nurture imposter 
syndrome. Imposter syndrome is a persistent cluster of negative self-beliefs (first studied in 
interviews with high achieving women [14]) that affects men and women equally[15], where the 
person does not identify as a valid member of a group, and attributes their successes to 
short-term luck or hard work, rather than their competence and ability. Imposter syndrome has 
been widely studied in academic and professional fields and is positively correlated with mental 
health concerns of underrepresented students [16] and [17]; see [18] for more examples. In the 
context of engineering education, [19] describes an instructor’s personal experience and 
suggestions of interacting with chemical engineering students with imposter syndrome but 
scholastic research on successful imposter syndrome inventions for engineering is scarce. 
Addressing imposter syndrome and providing multiple pathways to success may help with 
retention of all students but may especially help with equitable access for underrepresented 
students. This includes engineering disciplines with underrepresented gender and LGBTQ* 
gender identities [20], and ethnic and racial minorities, first generation students and students 
with disabilities. Availability of online videos is one mechanism that promotes students’ agency 
in their own educational activities, and allows multiple low-stress opportunities to learn and 
review material prior to high-stress, high-stake assessments. Future scholastic research into 
causal relationships and the efficacy of interventions to reduce imposter syndrome in 
undergraduate engineering education is worthy of future study. For the scope of this paper, the 
authors defined a more conservative hypothesis: Opportunities for low stress learning 
experiences prior to challenging assessments that lead to successful assessment outcomes will 
encourage students to be positive about their choice of major, and more self-confident in their 
future ability to succeed in their major. Though we do not examine learning outcomes by 
demographics, we note that equitable access to course video content can significantly lower the 
stress surrounding a course because students can watch and review content they did not at first 
understand and without judgement or comparison to their peers. 


Study I. CS & ECE classes replaced and supplemented in-lecture activities 


In 2019 and Spring 2020, several computer science (CS) and electrical and computer engineering 
(ECE) faculty used ClassTranscribe in their courses. For this study we analyze and report in 
detail on a large enrollment introductory ECE class and sophomore-level CS system 
programming class. 


The ECE “Introduction to Electronics” course goals are to excite students about the study of 
electrical and computer engineering by exposing them early in their education to electrical 
components and their application in systems, and to enhance their problem-solving skills through 
analysis and design. ClassTranscribe was first made available in the course during Fall 2019. 
There were 52 students who chose to use ClassTranscribe to also watch the recordings of the live 
lectures, approximately 13% of the total enrollment. In Spring 2020, students were again 
provided recorded lectures using ClassTranscribe. At mid-semester, the attendance requirement 
was dropped and students were allowed to attend a live, synchronous lecture or watch the 
ClassTranscribe videos asynchronously. Students could use ClassTranscribe anonymously, sign 
in using a personal gmail, or sign in using their university email address. The number of video 
minutes was only tracked in the latter case. Video minutes viewed were logged in 15 second 
increments. The histogram of student use of ClassTranscribe, when they used their University 
email, is shown in Figure 1. 
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Figure 1. The histogram of total video-minutes viewed by enrolled ECE students 
when ClassTranscribe was offered as a supplemental component. One student 
watched 4627 minutes of video, approximately double the actual content length. 
The total number of ECE students may be slightly higher than can be inferred 
from this figure because we report only students who signed in using their 
university email and excluded users who were anonymous or used a personal 
gmail address to sign in. 


Considering students who used the system at least once, a linear regression found a statistically 
significant effect (p < 0.04, n=231) where minutes-viewed predicted the student’s course total 
score: Students who watched at least 2000 minutes (equivalent to 40 lectures, each 50 minutes) 
were predicted to increase their course total by 2.4 absolute points on a 100-point scale, i.e. 
approximately one letter grade improvement (e.g. B to B+). This linear regression is illustrated in 
fig. 2 (upper line). 


ClassTranscribe was used in a supplemental manner, and many students were capable of 
achieving high scores without it (for example, review the prevalence of high scores near the 
upper-left area of fig. 2). To further analyze these data, we assumed an additive learning model 
(i.e., students could elect to perform additional, uncorrelated actions that further increased their 
competency and skills), which could be performed independently of measured ClassTranscribe 
use. Thus, for a known amount of ClassTranscribe use, the minimum observed score would 
represent the expected student ability with other independent additive processes minimized. 

One could measure the observed minimum score for evenly spacely binned ranges of video 
minutes (0,500,1000 ... 5000). However even-width bins would introduce an artificial sample 
bias because the observed minimum of a particular bin will be statistically biased to a greater 
value if the bin contains fewer samples than other bins. Thus, the data was split into ranges of 
equal sample counts (n=25). The bin ranges are indicated by the gray vertical lines in Fig 2. 
Using a linear regression, ClassTranscribe-use was found to be statistically significant predictive 
of improved course scores (p < 0.02) when considered as an independent learning activity under 
an additive learning assumption. For example, a student that viewed the complete course (2000 
minutes) using ClassTranscribe is predicted to achieve at least 73%, a passing score, 
independently of other uncorrelated factors that may further improve their course score. We next 
discuss ClassTranscribe in a Computer Science course. 
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Figure 2. A scatterplot of the student course totals for each ECE student that used 
ClassTranscribe at least once using their university email. Two statistically 
significant effects were found: The average course score improved by 2.4 points 
and minimum expected course score increased from 61% to 72% when students 
watched the equivalent of the full course videos (2000 minutes). 


The significantly positive effects on learning outcomes of adopting ClassTranscribe in a Spring 
2019 semester large enrollment (N=271) Computer Science sophomore-level core-curriculum 
system programming course has recently been reported in a 2020 paper [3] and are summarized 
here. The class cancelled regular physical lectures scheduled at 8 a.m. and instead used 
ClassTranscribe to provide web-based video lecture content. A subsequent analysis of students’ 
course performances found that all quartiles of the students’ course scores improved compared to 
students in all previous equivalent semesters. For example, the lowest quartile of the course 
scores improved by 3.3 points compared to the previous Spring semester (83.0 % vs 80.0%). 
With other course factors held constant over multiple past semesters (including unique final 
exams that were derived from a large random question set, course format, syllabus and 
instructor), the instructor concluded that at least the “First do no harm” principle had been 
satisfied by the adoption of the tool to deliver course content in a video format. 


A concern for educators and educational researchers is that course interventions and new 
opportunities presented to students are only utilized by the already highly-engaged, 
highly-motivated (“A” and “B” grade) students while leaving the remaining struggling students 
unaffected, or only weakly affected at best. Fortunately the adoption of this tool had the opposite 


effect: Student behaviors were analyzed and the tool's impact on the students' learning outcome 
were inferred by recording detailed student interactions over the last 6 weeks of the course. A 
statistical analysis in the same paper examined the effect of video minutes-viewed on improving 
final exam performance, by using course performance (excluding final exam score) as an 
independent variable. The large class size provided an opportunity to statistically analyze each 
quartile group separately. For each quartile, the students that used the tool an above average 
amount compared to their peers in the same quartile, were compared to students that used the 
tool less. All students who used the tool an above average amount improved compared to their 
peers in the same group (and this result was statistically significant), but the improvement was 
largest for the lowest two quartiles. The lowest quartile group improved their average exam score 
by 14.4 absolute points on a 100 point scale. A Mann-Whitney U test, which is similar to student 
t-test but does not require an assumption of normal distribution [21], found all improvements 
were Statistically significant (p<0.03). 


For each group, the above-average users of the tool exhibited a fractional improvement by 
reduction of 30-40% of final exam missing points, compared to their peers in the same quartile. 
These results supported the finding that use of ClassTranscribe is an effective learning technique 
that is open to students of all competency levels. The authors suggested this could be 
communicated to students as “Want to do well in the final? Take time to watch the videos over 
the semester and you can reduce your exam points you would have lost by a third.” 


The above paper only analyzed the total video minutes viewed by each student and did not 
analyze other student behaviors recorded by the tool. In this paper we describe the 13 different 
event types and examine other student behaviors. Specifically, we ask if event types were 
statistically predictive of improved student outcomes in the course. 


23151 Changed the playback speed 
17195 Selected full screen mode to watch a video 


1087 Updated search filter of the transcription interface 
Edited a transcription 


Generated a shareable URL of the current position 


Table 1. The 13 event types captured. 


The authors expected that students would post hyperlinks into an external discussion forum to 
discuss the most confusing or interesting moment of lecture. However the sharelinks feature was 
used only 13 times. Peer and forum-based discussion is an important pedagogical aspect of 
engagement and learning; therefore, a future version of the tool will promote the existence of this 
feature when students are first beginning to use the tool. Later surveys (see study II and III) also 
supported the finding that students were unaware of existing features beneficial for learning. 


We hypothesized that some events (e.g., using full screen playback) might be a proxy for a 
student committing their full attention to the content, and thus changing to fullscreen would be 
predictive of improved student outcomes. Other behaviors (e.g., pausing the video or switching 
to another activity) might be indicative of either partial attention and disengagement, or 
integrated behaviors where a student is using the video player in conjunction with another 
course-related activity (e.g., working on an assignment). No statistically-significant event 
measures (criteria Mann-Whitney U test, p<0.05) were found that impaired exam performance. 
In addition to measuring the total video minutes viewed, searching for content, changing 
playback speed and using full screen were behaviors rejected by the null hypothesis 
(Mann-Whitney U test, p<0.01) and predicted further improvement of final exam performance 
(see Table 2 and Fig. 3). Other event types had no predictive power (i.e., could not exclude the 
null hypothesis). For example, there was no evidence that pausing the video led to either 
improvement or impairment of final exam performance. Acknowledgement: These results were 
based on original work by Zhilin Zhang as part of his 2019 undergraduate thesis. 


Behavior N(Y0) N(Y1) mean(Y0) mean(Y1) threshold p-value 
Search Captions 185 86 79.5413.4 83.4+12.5 0.0 < 0.01 
Change Speed 199 72 78.4413.7 87.2+9.4 11332 < 0.01 


Full Screen 212 59 78.9+13.7  87.5+8.8 81.5 < 0.01 


Table 2. Behaviors that were predictive of exam performance. The mean and 
standard deviation for the final exam scores for students that included above 
threshold (group “Y1”) or below or equal threshold (group “Y0”’) of the described 
behavior. Searching captions, changing playback speed and using full screen 
options were correlated with improved final exam score (approximately 4 - 8 


points improvement). 


100 


Exam Score 


20 


Full Screen 


a] 
4 
w 
wu 
an 
c 
© 
= 
U 


Search Captions 


Figure 3. Student behaviors that were predictive of improved learning. Students 
who searched the transcriptions, changed video playback or used the full screen 
features more than average (Group Y1) than other students (Group YO), had 
higher final exam scores than those who did not. See Table 2 for details. 


Study II. Improving student outcomes in a Bioengineering lab safety and skills course 


In Spring 2020, ClassTranscribe was used in a required sophomore course for Bioengineering 
majors. The course included principles of cell biology inherent in tissue engineering design and 
lab experience in safely and skillfully manipulating mammalian and bacterial cells. 


The course included a lab practical exam that tested student ability to culture mammalian cells. 
As part of the practical exam, students are also required to use a brightfield microscope. Students 
are assessed on their ability to work in a biological safety cabinet (BSC) aseptically, and their 
ability to trypsinize cells, count them on a hemocytometer using a brightfield microscope, and 
successfully plate a new culture. Lab practical grades are assigned based on properly following a 
protocol, technique, following safety procedures, and use of the lab equipment (BSC and 
brightfield microscope). To prepare students for the lab practical exam, the course instructors 


created and distributed two training videos for students to use in preparing for the practical exam. 
The first video showed a student completing the protocol, with voiced explanations of each step. 
The second video demonstrated use of the brightfield microscope, including all dials to make 
appropriate adjustments (see Fig. 4). 


Figure 4. Screenshot examples of the training videos. 
Video attribution: Videos created by Benjamin David and Faisal Masood. 


The instructor analytics interface was used to verify that each student had watched the required 
videos. 


Students were also surveyed about the inclusion of online videos that were available outside of 
the lab time to watch and learn the practical skills and to understand the safety aspects of the lab. 
The survey included free response items and 5-point Likert Scale for response scales. There were 
11 respondents, though 2 were discarded because the respondents were unsure about which video 
system they used and their answers to subsequent questions were considered unreliable. The 
small number of responders is a limitation on the strength of the results presented below. 


Of the 9 responders, 7 reported the text search feature as “Very Useful” (highest scale response), 
though only half (n=5) were aware that the feature existed when using the tool during the course. 


ClassTranscribe was the most preferred system (n=3), followed by YouTube/Box (n=2). No 
student preferred the University-licensed commercial systems (Kaltura and Echo360). 


All students responded positively to “Should ClassTranscribe be used in BIOE 202 in the future? 
[Yes/No]” Students also suggested other BIOE classes that could benefit from ClassTranscribe, 
with “BIOE 206” (a sophomore Cellular Engineering lab course) being a popular suggestion. 


Free-form comments included feedback about the user interface and the utility of the search 
interface and being able to find the desired information. Some examples are below. 
“T love having subtitles on the other side of the screen so I can see what information is 
being presented in the current slide. Seeing what has been presented or is going to be said 
helps a lot as well, as it helps provide context. I also like being able to search for certain 
term.” 
“The text feature is really nice” 
“T really like the search feature within the transcript to find the info I need quickly.” 
“Tt was really helpful to be able to jump around by text keyword (even though not all the 
captions are very accurate) especially when looking for something specific from lecture 
to aid in completing an assignment. Much more efficient than jumping around aimlessly” 


We asked students to reflect on how useful ClassTranscribe was for learning, preparing exams 
and working on assignments. Students reported favorable and similar utility in all three 
categories (see the Lickert results presented in Fig. 5). Only one respondent chose “Not at all 
useful.” 
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Figure 5. Survey responses to the utility of ClassTranscribe for learning, preparing for 
exams and working on assignments in a bioengineering sophomore required laboratory 
course. Note for comparative visualization purposes, we conservatively represent 
“moderately useful” as a neutral response. 


These results are congruent with the survey results from earlier surveys in ECE and CS courses 
that have larger sample sizes which we report in the next section. 


The instructor also noted that behavioral analytic data in the form of downloadable event data 
and data visualizations enabled the instructor to identify when students stopped engaging with 
the course, discover the most viewed content and enumerate frequent and infrequent search 
queries. 


Study III. Student feedback on learning utility and digital accessibility 


To assess the perceived learning utility and digital accessibility for electrical and 
computing-related courses, students in a Fall 2019 ECE introductory course and CS system 
programming course in Study I were surveyed. In the Fall semester both courses had in-class 
lectures and written materials available (i.e, use of the tool as a primary or secondary resource 
was entirely optional). Surveyed students reported on the utility of the tool using a 5-point scale 
for different learning activities which we summarize below in Table 3. The top-3 survey 
responses (“Extremely / Very / Moderately useful”) were included in the numerator of the 
percentages below. A greater number of CS students responded to the post-semester survey 
because those students were offered a nominal | extra bonus point in the final exam. A 
third-party university survey service ensured student anonymity. 


How useful was the video ECE CS Respondents | Combined 
content for - Respondents 


- Learning the course material? | 100% (n=15) 89% (n=191) 90% (n=206) 


- Preparing for exams? 100% (n=15) 76% (n=191) 77% (n=206) 


- Help completing assignments? | 93% (n=15) 64% (n=191) 67% (n=206) 


Should ClassTranscribe be used | 100% (n=24) 96% (n=215) 96% (n=239) 
in this class again? 


Table 3. Summary of students’ opinions of the tool's utility for different activities and for 
the course as a whole. 


Free form responses included “I have a hard time understanding content right away in class so 
being able to watch lectures with the ability to speed up, slow down, and pause, is super 


1»? 


beneficial to my learning... it was great!” When asked what other classes would benefit 
suggestions included both lower and upper-curriculum ECE and CS classes and more general 
suggestions, “all classes its super useful” and, “All senior citizens should have Life Alert and all 


STEM classes should have ClassTranscribe.” 


The most surprising result to the authors was that only 40% (96/242) responded affirmatively to 
“Were you aware of ClassTranscribe's ability to search for course content using text search?” 
This supports the finding discussed earlier, that students are often unaware of learning aids in 
digital user interfaces. To address this deficit future versions of the tool will provide a short 
guided introduction to the functionality and the authors will continue to use surveys and behavior 
analytics to review student use of the learning features. 


For educators interested in understanding accessibility and disability needs of their students, we 
note that care is required to respect students' desire to not disclose their own disability. Thus 
accessibility and disability related survey questions in this study were framed from a broader 
perspective than merely the student's direct personal experience or disability- 


“Imagine that you or another classmate had a physical (e.g., hearing, vision, motor) or 
cognitive (e.g., ADD, ADHD, dyslexia) impairment. How useful do you think 
ClassTranscribe would be for a student with an impairment?” 


“How can we improve ClassTranscribe to be a better accessible learning tool? What 
feature(s) would increase the learning value of ClassTranscribe to you or to people with 
physical or cognitive impairments?” 


Results from the survey and feedback from disability experts were further used to improve the 
interface. The original and revised interfaces are shown below (Fig. 6 and Fig. 7). The original 
interface always displayed the captions under the video area. 


Figure 6. Two examples of the original 2019 web interface. The left screen 
capture shows a video playback with captions underneath. The right screen 
capture shows searching the video content using the captions. As the student types 
in a search term, matching caption lines from the entire set of course videos were 
immediately displayed. 
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Figure 7. Two examples of the redesigned accessible 2020 video interface. The new 
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video system provides far greater configurability of playback, which is particularly 
important for students with ADHD and ADD. For example, playlists, captions and 
transcriptions can be configured or hiddens, to help students concentrate on the content. 
In the screen capture above a non-native English student preferred to watch the videos 
with automated Spanish transcription (translations to Korean, Spanish and Simplified 
Chinese were provided). Configurable caption font size and color, background color, 
background transparency to assist deaf students and students with low vision, cognitive 
and reading difficulties (e.g., dyslexia). Text searching across the current video or the 
entire video set is now intuitive. 


Future work 
A student may exhibit several behaviors described in study I, and the importance and interaction 


of multiple behaviors recorded by the tool is worthy of further investigation in single courses and 
multiple types of courses. 


In this report we were not able to directly measure learning outcomes specifically for students 
with disabilities and International students. Future research will address these limitations. 


Improving digital accessibility is a continuous process and the tool developers will continue to 
work with disability experts and seek feedback from students with impairments. 


The next version of the tool currently in development can create accessible ePub (digital books) 
directly from video lectures. We look forward to reporting more on this work in a future paper. 


Conclusions and discussion 


In this paper we reported on three studies that focused on examples of adding ClassTranscribe 
into multiple engineering classes with multiple goals of improving digital accessibility, 
self-efficacy in the course (i.e., self confidence and self-beliefs in succeeding in their major) and 
effectiveness (at all levels of student ability). Learning outcomes and examples of adoption were 
presented under a diverse set of educational uses including use as a primary source of lecture 
content (CS, Spring 2019), secondary or supplemental review of recorded live lectures (ECE,CS, 
Fall 2019,Spring 2020) and pre-lab training for lab techniques and equipment use 
(Bioengineering, Spring 2020). Per-student learning data was used with gradebook data and 
demonstrated statistically significant positive learning outcomes in multiple courses. Behavior 
analytics and survey responses identified that some students were unaware of learning features 
and future versions of the tool could introduce the interface to the user. In all courses surveyed, 
BIOE, CS, and ECE students overwhelmingly recommended the use of the tool in future 
semesters. The majority of CS & ECE respondents found the tool moderately, very or extremely 
useful for both homework (67%) and exams (77%), with similar results in the smaller BIOE 
survey. Carefully worded surveys that respected a student’s right to not self-disclose disabilities 
were used to identify opportunities to improve accessibility features, which are being addressed 
in the next version of the tool. 


In closing, we summarize the benefits of why an educator or institution may consider adoption of 
ClassTranscribe and the use of searchable, accessible video content. From a Universal Design for 
Learning perspective [22],[23], low cost, accurate captions and transcriptions benefit not only 
students with hearing impairments, but also International students with imperfect English 
listening skills, blind students who listen to transcriptions using text-to-speech at high speed 
(>3x), and all students who want to search for relevant content, review content multiple times, or 
are in a noisy environment. Interfaces designed for ADD/ADHD may help all students focus and 
concentrate. Ability to choose font style, size and colors may help those with visual impairment 
or dyslexia. An interface that is fully accessible using keyboard alone benefits students with 
motor impairments and aids all students to navigate efficiently using keyboard shortcuts. 


Searchable online content is the de facto behavior of today’s learners. Providing means for 
students to find relevant video content can only help students prepare for assessments, homework 
and exams. Language translations further aid non-native English speakers and allow high quality 
engineering education content to reach a greater audience, and help set a new level of quality for 
engineering outreach content. From a competitive standpoint, the authors hypothesize it may 
further encourage top international and domestic students and students with disabilities to apply 
to US institutions that visibly assist all students to thrive in their educational program. 


Accessible access to online video content is one step towards equitable access for all students in 
engineering education. We invite engineering educators interested in adopting the tool to contact 
ClassTranscribe@classtranscribe.illinois.edu. 
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